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predict 1st year college grades and science, writing, art, music, speech, and leadership 
achievement were developed by analysis of 906 pre-college questionnaire items. Two 
item analysis strategies were used; responses of achieving subjects (S’s) and general 
samples of nonachieving S’s were compared; responses of achieving and nonachieving 
S’s who had previously indicated desire to achieve were compared. The two strategies 
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content of the scales and the correlations among variables support some unfavorable 
interpretations of high grade achievement. Results suggest the hypothesis that the 
grade scales should be a negative predictor of nonacademic achievement, and the 
nonacademic scales should predit grades negatively. (Author/JD) 
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Abstract 

o 

Using 857 male National Merit Finalists and Commended students, scales to 
predict first year college grades and science, writing, art, music, speech and 
leadership achievement were developed by analysis of 906 pre -college question- 
naire items. Two item analysis strategies were used: (a) responses of a- 

chieving Ss and general samples of nonachieving Ss were compared; (b) responses 
of achieving and nonachieving Ss who had previously indicated desire to achieve 
were compared. The two strategies did not yield essentially different scales. 
Validity coefficients ranged from .15 to .38 with 1 30 cross-validation Ss; 
similar correlations resulted from applying the scales to 68l female Ss. More 
items about past accomplishment, activities, and competence entered the scales 
than did other item types, relative to the size of the item pools. The content 
of the scales and the correlations among variables support some unfavorable 
interpretations of high grade achievement. An hypothesis about the character- 
istics of achievers in the various areas was suggested. 






Prediction of College Performance of Superior Students 

Hoy J. Roberts 

This study follows a series of reports from the National Merit Scholar- 
ship Corporation (NMSC) on the prediction of college performance (Holland, 
1953a, 1959, I960, 1961 ; Holland & Astin, 1962; Holland & Nichols, 1964; 
Nichols & Holland, 1963 ). In these studies, predictor data were gathered 
on high school students of very high scholastic aptitude, usually National 
Merit F inalis ts, and the college performance of these students was later 
surveyed. With aptitude controlled, nonintellective predictors can emerge. 

Not only is the nature of measures which differentiate high aptitude a- 
chievers from high aptitude nonachievers theoretically interesting, but 
differentiation among superior students is a practical problem at NMSC 
and at many selective colleges. 

The previous studies used standard published inventories, experimental 
inventories, and some a priori scales constructed at NMSC. The one item a- 
nalysis performed (Holland & Nichols, 1964) used criteria of high school 
extracurricular achievement in the development of “achievement potential" 
scales which were then used to predict college achievement. Cross-vali- 
dation correlation coefficients for these scales ranged as high as .64, and 
averaged .37. These results, in the context of the general findings of NMSC 

research, led Astin (1964) to suggest more use of empirical keying. 

In the present study, a large number of nonintellective items were em- 
pirically screened, and formed into predictor scales. All subjects were high 
aptitude students. The predictor data were collected prior to college en- 
trance, and the criterion data— grades, and science, writing, art, music, 
speech, and leadership achievement— were collected after one year of college. 
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A conventional item analysis method was used: for each criterion, a- 
chievers were contrasted with a sample of nonachievers. But while it may 
be reasonable to assume that all students should work at achieving grades, 
making a general sample of low grade achievers suitable for item analysis, 
the other criteria are of a different nature. Only some students are, or 
should be, interested in achieving in a given area. By definition, those 
who do achieve have the necessary interest or commitment. If they are con- 
trasted with a sample of nonachievers containing many students with no in- 
tention of working in the area, as is the case with the conventional item 
analysis method, items tapping interests should emerge strongly. Especial- 
ly if the students are all high in the important variable of scholastic 
aptitude, noninterest items which tap some essential quality might be over- 
looked. 

A second item analysis strategy was used: a search for items which 

differentiate achievers and nonachievers from among those who are trying 
to achieve. For each area of achievement, except grades, those students 
whose precollege responses showed some interest or c ommit ment to activities 
or achievement in that area were selected, and the predictor item responses 
of achievers and nonachievers from this ” committed* 1 group were compared. 

Method 

Subjects 

The subjects were Semifinalists or recipients of Letters of Commen- 
dation in the 1962 National Merit Scholarship program, which means that they 
scored above the 96th percentile on national norms on the National Merit 
Scholarship Qualifying Test. About 2400 students were mailed questionnaires 

prior to college entrance, and 1988, or 83$, returned them. These 1988 re- 

* 

ceived the second questionnaire one year later, and 1838 returned it; The 
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1838 used in this study are approximately 77$ of those originally contacted. 
There are 1157 males, and 68l females. All but 62 attended one of 32 col- 
leges and universities selected to represent a diversity of institutional 
types. 

Criteria of Achievement 

The post freshman-year questionnaire included checklists of achievement 
and a 10-point scale for reporting first year grade average: A, A~, Bf , B, 

C+, C, C-, I>, D or lower. In a study using a similar sample and item, 
the correlation between self-reports and grades obtained from transcripts 
for 157 subjects was .96 (Nichols & Holland, 1963)0 

Table 1 shows the areas of achievement defined as criteria, and the 
items used. Each criterion was dichotomized: achievement versus nonachieVe- 
ment for the nonacademic areas, and high (A or A-) versus low (Of or lower) 
for grades. 

Predictor Items 

The predictor items came from the pre college questionnaire. 

Responses to the following items were "like” or "dislike.” ’Like re- 
sponses were tabulated in item analysis. 

1. l60 occupational titles— These items comprise the Vocational Pre- 
ference Inventory (Holland, 1958b). 

2. 23 school subjects. 

3. 48 sports and games. 

Responses to the following items were "frequently," "occasionally," or 
blank. "Frequently" responses were tabulated in item analysis. 

4. 200 activities— Illustrative items: Building scientific equipment 

Camping; Reading historical novels; Daydreaming. 
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5* 76 places to be visited— Illustrative items: A professional stage 

play; A National Park; An operating room; A fashion show. 

The following items were checklists; the subjects responded to those 
which applied. 

6. 39 things which might be found in the home — Illustrative items: 
Power tools; A collection of classical records; A typewriter; Chemical 
laboratory equipment. 

7. 82 accomplishments— These items survey, rather comprehensively, 
achievement in science, the arts, leadership, etc. 

8. 3k attempted accomplishments— Respondents indicated the activities 
they had tried, not necessarily finished or accomplished. 

9. 143 competencies— Illustrative items: I can be a good hostess 

(host); I can design stage sets; I can read Latin; I can drive a truck. 

The following items have miscellaneous response formats. 

10. 29 traits and abilities— Respondents rated themselves on a 4-point 
scale. Responses at the upper point, ’’top ten per cent,” were tabulated. 

11. 35 life goals— On a 4-point scale, respondents indicated the im- 

portance of these aspirations. Responses were dichotomized, tabulating 
"essential" .and "very important"; "somewhat important" and "little im- 
portance" were the low responses. Illustrative items: Becoming happy and 

content; Making a technical contribution to. science; Being well read; Being 
a good parent. 

12. 18 intentions— Respondents indicated their intention to attempt 
each accomplishment "in college," "after college," or "not at all." The 
three alternatives were tabulated as separate items. Illustrative items: 
Join several organizations; Obtain a research grant; Compose music. The 
items parallel the criterion items in the second questionnaire. 
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13. 19 time diary items** -Respondents wrote in the hours spent on each 

of 19 classes of activity during "an average week" of the past school year. 

The responses were dichotomized as near the median as possible, and high 
responses were tabulated. Illustrative items: Studying for school assign- 

ments; Daydreaming; Participating in musical, dramatic, or artistic activi- 
ties. 

Procedure 

A o computer program (Nichols & Tetzlaff, 19^5 ) tabulated the responses 
of upper and lower criterion groups and calculated a phi coefficient for 
each item. These analyses were done only with the male subjects, since 
there were not enough female achievers for both item analysis, and cross- 
validation. The item analysis used 857 males; 300 were left for cross-vali- 
dation. (With the self-ratings, time diary, and life goals a blank item was 
not meaningful, so students with missing data, including some achievers, were 
not used in the analysis of these items.) 

For most areas of achievement the number of achievers was relatively 
small (see Table l), and 150 was a sufficient number for nonachieving groups 
for iter analysis. These groups were selected by reference to the final 
digits of the student identification numbers, where there was no systematic 
bias, in such a way that they did not contain the same subjects in each analy- 
sis. The numbers selected proved to be quite close to 150: the smallest was 
137 and the largest was 164. 

Separate item analyses were performed with a "commitment" strategy. 
Alternate definitions of commitment were tried. For each area of achieve- 
ment, the most stringent definition counted as committed those subjects who 
responded "in college" to relevant questions about their plans (items labelled 
"intentions" above). A second definition also included as committed those 
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who responded ’’after college.” In some areas a third definition added still 
more: those who rated a relevant life goal as ’’essential” or ’Very important." 
A t ally of the data showed, for each area, the number of people considered 
committed with each definition, and the number of them who achieved. For 
each area a definition was selected for further use; the basis of selection 
was the minimization of the percentage of people considered uncommitted who 
achieved. 

For one area. Art, a large proportion of those who achieved were con- 
sidered uncommitted by all definitions, and this area was dropped from this 
phase of the study. For the other areas, the definitions used are shown in 
Table 4. Item analyses were done with achievers and nonachievers from among 
the committed subjects. 

Items with phi coefficients significant at the .05 level were collected 
into scales, scored with one point for each response in the keyed direction. 
The correlations among all variables, the criteria and the scales, were com- 
puted separately for the item analysis subjects, the cross-validation sub- 
jects, and the females. The scale intercorrelations and correlations of 
scales with grades are product -moment; other criterion-scale correlations 
and the correlations of grades with other criteria are point biserial; and 
the rest of the criterion intercorrelations are phi coefficients. 

Results 

Table 1 presents the numbers of achievers in each area. The column 
headed "item analysis” shows the size of the upper criterion groups for item 
analysis. (The lower criterion groups numbered about 150.) The rate of 
achievement for all the nonacademic areas, except leadership, is not large. 
Since the, superior students in this study probably have a higher than average 
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rate for these achievements, the criteria defined seem to represent unusual 

and high level accomplishment during the freshman year. 

Table 1 



Area of 
Achievement 

Grades** 

Science 



Number of Achievers and Items Defining Achievement 



Males 



Items 



a 



a nr A- errades 



Females 

Item 

Total Analysis Total 
fN=1157) (N=857) (N=68l, 



Received a research grant 
Gave an original paper at a scien- 
tific or professional meeting 
sponsored by a professional 

society or association 0 25 19 9 

Had a scientific or scholarly paper 
published (or in press) in a 
scientific or professional jour- 
nal c 

Invented a patentable device 



Writing Had poems, stories, essays, or 

articles published- in a public 
newspaper, magazine, anthology, 
etc. (not college publication) 

Wrote one, or more plays (including 

radio or TV plays ) which were 96 71 67 

given public performance 
Had poems, stories, essays, or 
articles published in a college 
publication 

Won literary award or prize for 
creative writing 

Art Won a prize or award in an art 

competition (painting, sculpture, 

ceramics, etc.) 42 28 30 

Had photographs, drawings, or 
othei art work exhibited or 
published 

Music Performed as a soloist on radio or 

TV program 

Played in a professional jazz en- 
semble or dance band 
Won prize or award in musical com- 
petition as performer 
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Table 1 (cont) 



Achievement 



Items 



Music 

(cont) 



Speech 



Composed music which has been 
given at least one public 
performance 

Arranged music for public per- 
formance 

Had one or more musical publi- 
cations 

Performed with a professional 
orchestra 

Gave a public recital (not col- 
legiate ) 

Directed (publicly) a choir 

Placed 2nd, 3rd, or 4th in a de- 
bate contest 

Won one or more speech or debate 
contests 



Leadership Nominated for one or more student 

offices d 

Elected to one or more student 
offices 



Ifaipg Females 

Item 

Total Analysis Total 



60 48 37 



23 l 6 7 



261 186 215 



a Students who checked any of the listed items were identified as 
achievers for that area. 

b This entry is the number of people in the upper criterion group for 
item analysis • The lower group, those reporting Ot or lower, numbered 253. 

c These items were edited to remove students who prepared papers in a 
scholarly but nonscientific area. 

d This item was edited to remove all students except those nominated to 
an office judged to be major, or more than one minor office. 



In Table 2 are shown the intercorrelations among the criteria. Although 



Table 2 

Intercorrelations of the Criteria 

(Males below the diagonal, N=4$57; Females above the diagonal, N=68l) 



Criterion 



1. First year college grade s a 

2. Science achievement 

3. Writing achievement 

4. Art achievement 

5. Music achievement 

6. Speech achievement 

7. Leadership achievement 



1 


2 


3 


4 


5 


6 


7 
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00 


01 


02 


13 




-04 


-02 


-03 


-01 


-02 


-01 


o 4 




07 


07 


06 


04 


-01 


-03 


09 




-02 


-02 


05 


-o 4 


-o 4 


o 4 


07 




17 


02 


-02 


-02 


02 


02 


04 




-01 


02 


00 


04 


05 


o 4 


01 





a Conelations with grades were computed with N=845 for boys 
and N=668 for girls, since one college in the sample did not give 
grades to freshmen. 
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the larger correlations are statistically significant, the practical signifi- 
cance of Table 2 is that the criteria are relatively independent. The corre- 
lation between grades and scientific achievement »ayte an exception. 

Table 3 presents, separately for the cross-validation, item analysis, 
and female subjects, the correlations of the "conventionally developed" 
scales with all criteria. The correlations of the criteria with their 
appropriate scales are on the main diagonal of each matrix. The scales, 
developed entirely on males, generalized to a sample of females about as 
well as they held up with cross-validation on another male sample. 

Table 3 

Criterion-Scale Correlations 




Criteria 
Item Analysis 

Ss (N=85T) 

Grades 

Science 

Writing 

Art 

Music 

Speech 

Leadership 

Cross-validation 

Ss (M=300) 

Grades 

Science 

Writing 

Arb 

Music 

Speech 

Leadership 

Female 

Ss (N=68l) 

Grades 

Science 

Writing 

Art 

Music 

Speech 

Leadership 



2L 

09 

-07 

-03 

05 

03 

-09 



20 

05 

06 
05 
01 

-03 

-01 



08 

32 

08 

06 

02 

04 

05 



02 

23 

Ok 

15 

05 

01 

12 



08 

07 

00 

01 

-05 

00 

-08 



01 

10 

05 

09 

-03 

11 

05 



-08 


-10 


02 


-01 


-10 


00 


01 


-01 


00 


00 


32 


16 


07 


27 


18 


05 


ko 


03 


12 


04 


0k 


07 


Jfi 


00 


01 

06 


09 


05 


01 


32 


17 


o6 


05 


15 


34 


00 


-07 


-03 


0J 


-01 


-03 


09 


02 


-01 


-01 


12 

03 


07 


07 


21 


06 


l8 


02 


05 


o4 


07 


08 


38 


-01 


02 


19 


-03 


03 


21 


15, 


12 


10 


08 


Ik 


12 


-06 


-13 


-06 


-02 


-05 


-09 


02 


-02 


-Ok 


-o4 


23 


Ik 


05 


19 


11 


06 


24 


00 


10 


03 


15 


07 


28 


12 


O H 
oo ro 


05 


07 


-01 


12 


10 


09 


06 


ok 


11 



Students who responded as shown to any listed item were identified as committed in that area 
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Table 4 

Ifumbers of ComF ’ ’-.ted and Achieving Committed Students and Items Defining Commitment 8, 
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Table k (page 10 ) shows the number of student's identified as committed 
to activity in each achievement area, and the number of them who achieved, 

A comparison of Tables 1 and 4 shows that the achievers who were classified 
as committed are a large proportion of the total achievers. The items used 
for commitment selection (shown in Table k) are evidently good predictors 
of achievement. 

The correlations between the scales derived from item analyses within 
the committed subgroups and the conventionally developed scales are shown in 
Table 5. The item overlap between the paired scales was great, and the high 



Table 5 

Correlations between Conventional Scales and 
"Commitment n Scales 





tfeles 

(N=300) 


Females 

(N=68l) 


Achievement area 


r 


r 


Science 


.89 


.79 


Writing 


.96 


.95 


Music 


.70 


•66 


Speech 


.63 


.6k 


Leadership 


.86 


.8k 



correlations of Table 5 demonstrate the similarity of the scales. Bub the 
commitment scales do have some variance unshared with the conventional scales. 
If this variance is highly related to the criteria, the commitment scales 
could be superior predictors. 

Table 6 presents the correlations between the commitment scales and the 
appropriate criteria. These validity coefficients are very similar to those 
in Table 3* indicating a failure for the strategy of taking commitment into 
account. If there are any differences, they seem to favor the conventional 



scales 
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Table 6 * 

Correlations of the Criteria with the Appropriate 
" Commitment “ Scales 



Criterion 


Item 

Analysis 

(N=857) 


Cross 

Validation 

(N=300) 


Females 

(N=68l) 


1. Science achievement 


.37 


.21 


.04 


2. Writing achievement 


.39 


.16 


.24 


3. Music achievement 


.48 


.38 


• 

ro 

o 


4. Speech achievement 


.34 


.11 


.07 


5. leadership achievement 


.32 


.14 


.12 



In Table 6 the commitment scales were applied in the same m a nne r as the 
conventional scales • Table 7 extends the commitment strategy to the appli** 
cation of the scales. Achievement was predicted for the subjects with the 
highest scores on each conventional scale; the number of subjects thus se- 
lected was determined by the rate of achievement in the item a naly sis sample. 
The act ual achievement of these subjects is shown in Table 7 • With the com- 



Table 7 

Act ual Achievement of the Highest Scale Scorers in 
the Cross Validation Sample 



Achievement area 


Highest Scorers on 
Conventional Scales a 


Highest Committed Scorers 
on “Commitment 11 Scales^ 5 


Achievers 


Non- 

achievers 


Achievers 


Non- 

achievers 


Science 


2 


6 


2 


5 


Writing 


6 


20 


5 


20 


Music 


6 


10 


6 


10 


Speech 


3 


3 


0 


7 


Leadership 


27 


44 


24- 


47 



a For each achievement area, the number of top scorers se- 
lected was determined by the rate of achievement in the item 
analysis sample. 



^ "Uncommitted" subjects were automatically excluded. 




mitment scales, nonachievement was automatically predicted for “uncommitted" 
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subjects, whatever their commitment scale scores: all of the highest scoring 

subjects whose achievement is shown in the last two columns of Table 7 are 
committed. (Small differences in the total number of subjects for whom a- 
chievement was predicted by the two methods are due to tie scores on the 
scales.) The numbers of subjects are small, but the conclusion is based 
upon five separate comparisons: in no case did taking commitment into ac- 

count improve prediction. 

The conventional scales are the subject of the rest of this report. 



Their ihtercorrelations are shown in Table 8. These relationships are much 
higher than the criterion intercorrelations. Item overlap can account for 
only a s mall part of the size of the positive correlations. For example. 

Table 8 

Intercorrelations of the Scales 

(Males below the Diagonal, N=300; Females above the Diagonal, N=68l) 
Criterion 



1. First year college grades 

2. Science achievement 

3. Writing achievement 

4. Art achievement 

5. Music achievement 

6. Speech achievement 

7. Leadership achievement 



1 


2 


3 


4 


5 


6 




19 


-51 


-34 


-14 


30 


31 




04 


43 


04 


20 


-48 


-03 




55 


40 


76 


-27 


49 


43 




30 


53 


-06 


19 


4l 


39 




21 


-20 


18 


74 


39 


23 




-64 


07 


80 


44 


28 


67 



-65 

16 

76 

50 

33 

64 



the speech and art scales shared 14 items; the writing and leadership scales 
shared 28 items; and the science and music scales shared 7 items, with 3 of 
them keyed in opposite directions. 

Grades Scale 

This scale included 222 items, with 182 keyed negatively. The largest 
cluster of positive predictors relates to scientific and mathematical inter- 
ests and abilities. High achievers also were more likely to have had musical 
interests and experience. One positive item concerned placing in a speech 
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or debate contest. The remaining interpretable positive predictors were 
items, such as self-rating on scholarship, with content rather obviously re- 
lated to grades. 

Negative predictor groupings are: (a) interest and participation in 
sports, games, and outdoor activities; (b) social activity and interpersonal 
competence; (c) entertainment (e.g., TV watching); (d) "practical" abilities 
(e.g., shingle a roof, adjust a carburetor); (e) interest in leadership 
positions; (f) many occupations, especially those relating to business, me- 
chanical qualities, "adventurous" qualities, the law, and counseling or 
helping activities; (g) a heterogeneous list of activities and accomplish- 
ments. 

Science Scale 

This scale included 80 items, with 15 keyed negatively. There are more 
items with very low frequencies of endorsement than in the other scales. 

More than half of the positive predictors are direct indicators of scien- 
tific activity or interest, and several others may be "technological in 
nature (e.g., photography, nature collections). The remaining positive pre- 
dictors do not form readily interpre table groupings. 

.Among the negative predictors are several life goals relating to com- 
fort, happiness, and contentment, and to finding a purpose in life. Two 
negative items concerning social activity may be noteworthy: fewer science 

achievers reported frequent party attendance and social dancing. 

Writing Scale 

This scale included l6T items, with 20 keyed negatively. About one- 
third of the positive predictors concern writing ability or interest, pub- 
lishing activities, reading and books, etc. Drama and entertainment, speech 
and art are represented. The remaining groupings of positive predictors are 



(a) leadership and politics; (b) competence and interest in interpersonal 
relations (e.g., interest in social worker, baby sitting activity, enter- 
taining older people); (c) games (e.g., charades, chess); (d) interest in 
history; (e) diverse experiences, activities, and competencies. 

The negative predictors indicate a lack of scientific or technological 

interest among writing achievers. 

Art Scale 

This scale included 97 items, with six ':eyed negatively. Nearly half 
the positive predictors concern interest or ability in art, design, and 
photography. The remaining positive predictor groupings are: (a) activity 
and interest in writing and publication; (b) science; (c) entertainment 
(e.g., interest in television producer, dramatic interpretations); (d) a few 
"practical" abilities and activities (e.g., work own business, drive a truck, 

iron clothes). 

The negative predictors may indicate a lack of interest in organized 
sports . 

. Music Scale 

This scale included 129 items, with 17 keyed negatively. Well over half 
of the positive predictors are directly concerned with musical interest and 
ability. Art, writing, drama, and speech account for several items. Travel, 
sightseeing, and a number of places visited are positive predictors, as are 
ability at entertaining and being a host. 

Although belonging to an honorary scientific society was a positive pre- 
dictor, several negative predictors seem to indicate a lack of commitment to 
science. There is also a suggestion of a lack of interest in sports. 

Speech Scale 

This scale included 72 items, with 15 keyed negatively. Nine positive 
predictors refer directly to ability or experience in speech. Other groupings 
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of positive predictors are: (a) literature, drama, books, and work on publi- 
cations; (b) art and design; (c) politics, leadership, organizations, and 
interest in history. The remining positive predictors are not readily in- 

terpretable • 

Among the negative predictors was dating. 

Leadership Scale 

This scale included 135 items, with five keyed negatively. Thirty-four 
items refer directly to leadership aspiration and experience, organizations, 
and politics. Other groupings are: (a) writing; (h) speaking; (c) social- 
izing (e.g., dating, high popularity self-rating); (d) legal occupations; 

(e) science, especially zoology and physiology. A large number of items are 
not grouped; they seem to indicate a wider range .of activity, experience, 

and interest for leadership achievers. 

The items composing each scale are classified hy type in Table 9 » For 
each scale, the numbers of items of each type are given, and these numbers 
are converted to percentages of the total number of items of that type in 
the item pool. One type listed in the description of the predictor item pool 
earlier in this report is omitted from Table "Intentions." These items 
had three response alternatives, which could enter the scales as separate 
items, and it is nob legitimate to compare quantitatively the representation 
on the scales of these items with that of the other items. A large number 
of the intention items did enter the scales, which is not surprising, since 
many of the criterion items are almost parallels of these intentions. 

The next to last column in Table 9 shows the averages of the percentages 
of each item type, which are intended as indices of the efficiency of each 
item type. The last column presents the average percentages with the grades 
scale om itted from the calculations, probably a legitimate omission since . 
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The Composition of the Scales 
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grades are a different order of accomplishment than the extracurricular a- 
chievements, and since the majority of items on the grades scale were keyed 
negatively, making their interpretation different. 

The accomplishments, activities, and competencies were the most effi- 
cient item pools in numbers of predictors. Their representation on the 
scales is high overall, and, unlike the self-ratings, for example, is high 
on most of the individual scales, indicating some consistency. 

Discussion 

From the practical prediction point of view, the results of this study 
are obvious. In the first place, the strategy of talcing commitment into ac- 
count was a failure - The conventional and commitment scales contained almost 
the same items, and the commitment scales predicted no better, whether they 
were applied to all subjects or only to committed subjects. The two sets 
of scales are- basically interchangeable, and it is the conventional scales 
which are the subject of the rest of this. report. 

The validity coefficients of the scales are not high. Although some of 
them better the multiple correlation coefficients reported by Holland and 
Nichols (1964), some are lower, and it might have been hoped that item analy- 
ses would yield better results than the more rational procedures of the 
earlier NMSC studies. The validity coefficients of the scales shrank con- 
siderably upon cross-validation. Evidently the completely empirical selection 
of items allowed a number of chance relationships to enter the scales. 

The -validity coefficients reported are point biserial. Biserial coeffi- 
cients would, of course, be higher, but the point biserial correlation is 
more realistic and justified in the present situation, and more comparable 
to the coefficients reported in earlier NMSC studies. 

Some factors related to achievement may not be the same in all institutions. 
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since college environments probably differ in the opportunity and encourage- 
ment they offer for various achievements. Scales developed and applied with- 
in one institution, then, might have higher predictive validity than those 
reported here. However, for many purposes prediction for college students 
in general is precisely what is needed. More broadly, an understanding of 
the factors related to success whatever the specific environment is important. 

With a group highly selected on academic aptitude, even validity coeffi- 
cients of around .20, as reported here, may be indicative of valuable pre- 
diction. Studies of National Marit Finalists have found very s mall or non- 
significant relationships between grades and academic aptitude (Holland & 
Astin, 1962; Holland & Nichols, 1 96k; Nichols & Holland, 1963). 

Practically, the criteria used were independent, although the larger 
criterion int ere orrelat ions are statistically significant. Holland and 
Nichols (1964 ) reported some higher relationships for s imil ar areas of a- 
chievement, but their criterion scales included items of lower quality of a- 
chievement, and were continuous rather than dichotomous. When separate inter- 
correlations were computed for what were called "rare achievements” the values 
were more comparable to the present results. Mich the same observations and 
conclusions pertain to a similar study by Nichols and Holland (1963). 

Inasmuch as grades are often used as the sole criterion for judging stu- 
dents, the lack of relationship between grades and the other achievements is 
especially noteworthy. Only science achievement correlated significantly with 
grades among males. This relationship did not emerge consistently in earlier 
NMSC studies • 

The findings on discriminant validity support the characterization of 
the criteria as independent. In the cross-validation sample, in only one in- 
fbance was a crite \\on predicted better by an "outside" scale than by its 
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intended scale: the speech scale correlated *21 with writing achievement, 
while the writing scale validity coefficient was .15 • The speech scale also 
correlated nearly as high with leadership achievement ( .1^-) as the leadership 
scale did (. 15 ). It appears that some combining of criteria may be practical. 

Accomplishments, activities, and competencies were the most efficient 
item pools: a higher proportion of them shewed predictive relationships with 
the criteria. Although it is not quantitatively demonstrated, ta k i n g the 
size oi i-j item relationships into account does not change this conclusion. 
Holland and As tin '1962) specifically concluded that the best single predic- 
tor they tried was high school achievement in areas similar to the college 
criteria. 

The results can be considered substantively, apart from the viewpoint 
of practical prediction. The content of the scales, and the patterns of corre- 
lation among variables, might offer some clues for the understanding of col- 
lege achiev eme nts and the characteristics of achievers. Several cautions, 
many of which also apply to conclusions presented earlier in this report, 
are necessary: (a) The scales were constructed with all ma le samples, (b) The 
first year of college may not be typical, (c) The response frequencies of 
some items in the scales were very low; although these items were predictors, 
they do not characterize many members of a group, (d) The rate of achievement 
in some areas was low. The resulting small size of the item analysis groups 
may have contributed to the large shrinkage on cross-validation by allowing 
unreliable items to be included in the scales, (e) Only statistically sig- 
nificant items are included. Areas of content which differentiated achievers 
from nonachievers with consistent results from diverse items would be over- 
looked if no item reached statistical significance, (f) The fullest interpre- 
tations would come from seeing the items which did not predict, as well as 
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the predictors, (g) The size of the predictive relationships is not present- 
ed for individual items, (h) The findings are no better than the item pool: 

important areas of content could be missing. 

In addition, the high aptitude of the sample imposes some risk in gener- # 
alization to more typical students. However, academically talented students 

are an important group for study in themselves. 

The majority of items in the scale to predict grades were endorsed by 
fewer high grade achievers than low grade achievers. From the content of 
these negative predictors, it appears that college freshman "A" students had 
fewer interests, were less active, less social, and less competent in a number 
of practical, everyday affairs than were "C" students. They did not have 
fewer accomplishments (few, if any, of the negative predictors represent real 
achievement), but they did not have more. In short, some of the popular un- 
favorable stereotypes of high grade achievers are supported. 

The nonaca demi c scales are almost entirely made up of positive pre- 
dictors: more of the achieving subjects endorsed the items, expressing inter- 
est, activity, or competence, than did the nonachievers. Many of the items 
in each scale were directly content -related to the area of criterion achieve- 
ment, and a fair number were related to other specific areas of activity and 

achievement . 

It may be that nonacademic achievers are more' active generally, with an 
additional past record of achievement in a specific area which indicates the 
direction of like ly future achievement. If so, it is not surprising that the 
nonacademic scales inter correlated positively, to an extent well beyond the 
item overlap, since there would be some general level of activity and achieve 
ment in all these scales (in each item analysis, the great majority of non- 
achieving subjects did not achieve in any area). Further, the negative corre- 
lations between the nonacademic scales and the grades scale would be expected. 



If active people tend to nonacademic achievement , and inactive people to 
academic achievement, the nonacademic criteria should correlate negatively 
with grades, and positively with one another. The obtained correlations are 
very near zero, but four of the seven which are negative in sign involve 
grades. The other three involve science, which, rationally, maybe more 
hvp grades than the other accomplishments: most science activities are 
probably directly related to classroom experience and learning, especially 
when laboratories are used. The largest criterion intercorrelation is be- 
tween science achievement and grades, . 13 . 

If the abo\re. accounting of the nature of the achievements is correct, 
the grades scale should be a negative predictor of nonacademic achievement, 
and the nonacademic scales should predict grades negatively. This expec- 
tation is not clearly confirmed, but in the item analysis sample (which is 
the best for this comparison: N is larger, and the scales are not being ap- 
plied to the s ame data or areas of achievement on which they were developed) 
three correlations of the grades scale with other criteria are negative in 
sign, and four correlations of the other scales with grades are negative. 

The only remaining negative correlation involves science achievement. In 
contract, the relationships between the nonacademic criteria and the inap- 
propriate nonacademic scales tend to be low positive. 

The interpretation presented can not be regarded as established, espe- 
cially as it make s use of nonsignificant correlation coefficients. Other 
hypotheses are possible. However, the interpretation does fit the general 
pattern of results (nonsignificant results were not considered in isolation). 

It does seem that some negative stereotypes of high grade achievers are 
supported. Past studies have found grades related to conformity and femi- 
ninity, a lack of dominance and social presence, passivity and timidity, a 
lack of potential for originality, and self-control (Holland, 195 9 ^ 19 ^ 0 ; 
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Ho lla nd & Astin, 1962; Nichols & Holland, 1963). (The findings concerning 
dominance, social presence, and leadership are not entirely consistent.) 
Nichols (1965) found, with an item analysis, that high grade achievers were 
characterized by fewer interests, seemed less active, and were more con- 
forming. 

The picture of the high grade achiever which has been drawn in this 
report is not an altogether happy one. Whether the situation warrants 
change, to what extent change is possible, and how change might be accom- 
plished, are questions which deserve further consideration. 
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